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Abstract 

This paper concerns the estimation of a function at a point in nonparametric het- 
eroscedastic regression models with Gaussian noise or noise having unknown distri- 
bution. In those cases an asymptoticahy efficient kernel estimator is constructed for 
the minimax absolute error risk. 
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1 Introduction 



We consider tlie problem of estimating a regression function S* at a given point 
-^o £]0; 1[ under observations 

yk = S{xk) + g{xk,S)£,k, ke{l,...,n} (1) 

where the regressors Xk = k/n are deterministic, ^k are independent iden- 
tically distributed random variables which will firstly be assumed Gaussian 
standard then having unknown density. Notice that the variance of the noises 
g"^ is unknown and depends on the unknown regression function 5* and the 
regressors Xk- 
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Heteroscedastic regression models with this type of scale functionals have been 
encountered in consumer budget studies utilizing observations on individuals 
with diverse incomes, in analysis of investment behavi or of firms of different 



sizes a nd more recently in medical research. For example, iGoldfeld and Quandt 



( I1972I ) considered polynomial regression models such that yk = + + 
Ufc, lE(tifc) = a + bxk + cxl, which is a particular case of our model ([1]) 
if we assume the unknown regression function being like S{x) = a + jSx 
and g'^{x, S) = {a — ^) + (b — x + ■^S'^{x). Other heteroscedastic re- 
gression models are studied for instance in lEfromovich and Pi nskerl (119961 ). 



Galtchouk and Pergamenshchikov (2005) and Efromovich (200Z). 



The problem of Holder regression estimation has been studied by several au 
thors. For a regression function belongin g to a quasi- Holder class a nd esti 
mated at a point with squared error loss, ISacks and Ylvisakerl (119811) showed 



that the linear minimax estimator is a kernel estimator. Donoho and Liu 



( ll99ll ) further found that this estimator is within 17 percent of asymptoti- 
cally minimax among all procedures and obtained optimal kernels for Holder 
classes. For estimating the whole object or it s kt h derivat i ve wi th sup-norm 
global loss and Holder class. iKorostelevI (Il993l ) and lDonohd ( 11994 ) proved that 
a kernel estimator is asymptotically efficient. 



This article deals with nonparametric estimation of a regression function be- 
longing to a Holder ball. We work with the absolute error loss and the corre- 
sponding risk. Our aim is to find an efficient estimator, that is to say an estima- 
tor which achieves the sharp asymptotic be havior of the minimax risk. To that 
purpo se we use the method developed by iGaltchouk and Pergamenshchikov 
( I2OO6I ) who introduce the local weak Holder classes to define the risk of an 
estimator. So we use the classes Uzg^s which allows an arbitrary large derivative 
but has a Holder condition based on a Holder constant tending to zero (see 
([2])), then define the risk TZzq,5{S) of an estimator S of S{zo) and the min- 
imax risk ini TZzfj s{S) (see ( fTTj) ). In these conditions we prove that a kernel 
s 

estimator is asymptotically efficient, it means that the minimax risk attains 
the sharp asymptotic constant. 



This paper is organized as follows. In section 2 we describe the problem in the 
case of Gaussian noise with all assumptions needed and define all necessary 
mathematical objects. Our main results of this problem are written in section 
3. The case of unknown noise is related in section 4. Theorems are proved in 
section 5 and appendix A contains useful results for our proofs. 
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2 Statement of the problem 



Consider model ([T]) where g : [0; 1] x C-'^([0; 1],M) — > M*^ and S are unknown 
functions, S belonging to the class 

np)= u nM,K,(3), 

M>0,K>0 

where /3 = 1 + a is known, a g]0; 1], Ti^M, K, [3) is the Holder class defined as 

\S\y)-S'{x)\ 



l-L{M,K,f5) = {S ^C\[Q]l\ 



S'\\<M, sup 



< K 



a;,ye[0;i] F " 2/l 



with II / 11= sup |/(x)|. We suppose that the noises (^fc)i<A;<n are independent 

x6[0;l] 

identically distributed A/'(0, 1). 

As mentioned in the introduction, we will work with a minimax risk taken 
over the local weak Holder class at the point zq defined, for < 5 < 1, as 



U.. 



e H{I3) : \\S'\\ < r^; V/i > 0, (S{zo + hu) - S{zo))du < 

(2) 



Notice that 

nl 



(^S{zo + hu) — S{zo)^du ■■ 
so we have for all 5* G TC{M, K, j3) 



1 / nzo+uh 



1 W^o 



-1 



S{zo + hu) — S{zQ)]du 



{S'{t) - S'{zo))dt]du, (3) 



< h^. 

- Pi(3 + l) 



That is why the class Uz^^s is called a weak Holder class. 
Furthermore ([3]) implies that TC{6~^, 6, [3) C U-z^^^s for any < (5 < 1. 

Let us give the assumptions needed. Firstly we suppose that 



lim sup 



with 



h 



^g'^{xk,S)] -g{zQ,S) 



(4) 



A:=l 



h 



Moreover we assume that there exists (7* > and g* < 00 such that 
< inf inf q(x,S)< sup sup q(x,S)<q* 

- 0<x<l56C7i([0;l],R)^' 0<x<l SeCi([0;l],ffi) 



(5) 
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and that the function g is differentiable in the Frechet sense with respect to 
S in Ci([0; 1],R) uniformly over x G [0; 1], i.e. for any S, So G C^([0; 1],R) 

g{x, S) = g{x, So) + Lx^SoiS - Sq) + T^^Soi^ - 5'o), (6) 

where the hnear operator L^^So is bounded on C^([0;1],M) uniformly over 
X G [0;1], i.e. for any So G C^([0;1],]R) there exists some positive constant 
Cso such that 

sup sup \L^^SoiS)\/ II S \\< Cso (7) 

x&[0;l] SeCi([0;l],lK), ||5||7^0 

and the residual term r2; ,5Q(S') satisfies the property 

hm sup r.,c,,(^)/l|5||=0. (8) 

ll-S^IHOxe[0;l] 

Remark 2.1 

Note that hypothesis is verified when for all e > 0, there exists rj > such 
that if \x — zo\ < rj, then sup \g{x, S) — g{zo, S)\ < e. 

In particular a function g satisfies this property if it is uniformly continuous 
with respect to both variables. 

Remark 2.2 

Let us give a general example of a function g satisfying hypothesis 

above. Let V : R — *■ M+ and G : [0; 1] x M — > two differentiable functions 

such that 



|V^'||oo < oo, = inf G{x,y) > 0, G'^ = sup 

xe[0,l], ym xe[0;l], yeR 



< oo. 



Define 

g\x, S) = G{x, S{x)) + V{S{t))dt. (9) 

Jo 

The derivative in the Frechet sense of g is given by 



1 fjf^ 1 



SO we have 

\Lx,sif)\ ^ ^1 + 
sup sup < ^ ■ 

Writing Taylor's expansion of functions y h- * G{x,y) at the point {x,S{x)) 
and V at the point S{t) to the first order: 
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dC 

G{x, S{x) + fix)) = G{x, S{x)) + —{x, S{x))f{x) + f{x)e,,s{f{x)), 

v{s{t) + fit)) = v{s{t)) + v'{s{t))f{t) + fm,s{fit)), 

we can easily show that 

rj -u iiT/'ii 

g\x,S^f)-g\x,S) 



+ ^ + 1 k~t,5(/(t))Mt) . (10) 

Now if we take G{x^y) = + + Q;2sin^?/ and V{y) = a^siia^y for all 
{x,y) e [0,1] X M, with ao > and ai, 02,0:3 G M+, then the function g de- 
fined as ^ is uniformly continuous, bounded by ^/aQ and y/ao + 01 + 0:2 + 03. 
Moreover by writing explicitly the functions 6^,3 o,nd e^^s for this case, we can 
prove thanks to l[Td\) that g satisfies hypothesis Iji^. So we have exhibited an 
example of function g which satisfies all assumptions needed. 

For any estimator Sn{zo) of 5(2:0) we define the following risk 

Tlzo,5{Sn) = sup EsiPn 7 T^T , (U) 

where is the expectation taken with respect to the law P5 in ([T]) and 

The aim is to attain the sharp constant with this rate It is only assumed 
that /5 g]1; 2] because if /3 > 2 we should use a kernel Q of order i.e. such 
that / u^Q{u)du = for j = 1, 2, . . . , and / Q{u)du < 00, where [a] denotes 
the integer part of the number a. 



3 Lower and upper bounds 



In this section we give the lower bound for the minimax risk and show that 
the kernel estimator Sn{zo), defined by 

Snizo) = -tQ{^^^)y,, (12) 

is asymptotically efficient as we give the upper bound for its risk. 
Theorem 3.1 For any 5 g]0; 1[, 




e~Ar(0,l), 
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where the infimum is taken over all estimators S of S{zq). 



Theorem 3.2 For the estimator Sn^zo) from / fi^) . the following inequality 
holds: 



limsuplimsup7^2o,5(S'„(2;o)) < ^ ~ A/'(0, 1). 



4 Case of unknown noise distribution 



In this section we suppose that the {^k) in model ([T]) are independent identi- 
cally distributed with an unknown density p belonging to 



e,L 



xp{x)dx = 0, / x^p{x)dx = 1, / \x\'^'^'^p{x)dx < L> 



with e > and L > sufficiently large to have the density of the standard 

Gaussian random variable in Ve^l- 

We define the risk corresponding to this case as 



'R-zo,s{Sn) = sup sup EsiPn 



\Sn{Zo) - S{Zo)\ 



In the following theorems we give the sharp lower bound for the minimax risk 
over all estimators and establish the upper bound for the minimax risk for the 
kernel estimator Sn^zo) of S{zq) defined in (IT^ . 



Theorem 4.1 For any 6 g]0; 1[, one has: 

E\n\ 

lim inf inf TZ,, siS) > r] ~ ^^{0, 1] 



n—*oo 



where the infimum is taken over all estimators S of S{zq). 



Theorem 4.2 The kernel estimator [Wjl is asymptotically efficient. Indeed it 
satisfies the inequality: 

limsuplimsup7^^o,5(S'„(2;o)) < ^=r, r/ ~ A/'(0, 1). 

5^0 n^oo y / 



6 



5 Proof of the theorems 



5. 1 Proof of theorem \3.1\ 



For all V G 
defined by: 



0; \ , denote S„{x) = ^n^Vy ^ — ) , where the function is 



\ r+oo _ — 
Vy{x) = - Qv{u)l du , Qy{ti) = l{\u\<l-2u} + 21{i_2i.<|«|<l-i.}, 

ly J—oo \ V / 

and / is a non-negative function, infinitely differentiable on M, such that for 
\z\ > 1, l(z) = and J l(z)dz = 1. One can easily see that for any < z/ < |, 

we have K(0) = 1 and J Vy{x)dx = 2. 



Let z/ e]0; H b > and 6 g]0; 1[. Denote S^^^ix) = — K ( — r"^ ) ' ^^ere 



Thanks to lemma \KA\ if \u\ < b there exists an integer ny^b,s > such that 
Sv,u £ i^zo,5 for all n > niy^b,6- Therefore for n > n^^b^g, one has: 



^^0,5(5') > sup — — ^——Es,,^(pn\S{zo) - Sy^u{zo)\ 

\u\<b g[Zo, Oiy,u) 



1 fb 

2b J-b g{ 



> — I -r^-ET^^s, u^a (<^n{S{zo) - 5'^,„(zo))) du := In{a,b), 



where Va{x) = \x\ A a,a > 0. 

Write Ps„„ the law of {yk^)k=i,...,n, where = S^^uixk) + g{xk, Su^u)C,k, and 
P the law of {yf^)k =i,...,n, where yf'' = g{xk., Su,u)ik- These two measures are 
equivalent and the corresponding Radon-Nikodym derivative is at the point 
(2/1, • • •,!/«): 



Pn[.u) 



d¥ 



^ k=i 



yk Sp^u{Xk) 



yk 



w 2 

exp \ - 



7 



where = -j E o ^ and = -— ^ ' . Vk- 

Under the law P, rjn is a standard Gaussian random variable. 

We prove in lemma IA.2I that 

<^2 , Jli^dz =: al. (13) 

So we rewrite Pn{u) = Gxp (ua^rjn — ^^-^ + Tn'j , where r„ converges in P- 
probability to zero. 

Denoting ipa,n{^, Su,u) = Va{fn{Sn{zo) - S^^u{zo))) and E the expectation for 
the probability measure P, one has 

In{a, b) > ^ [ EIb^ '^aAS,Sy^u) ^^^^-^^^ ^^(^^^ ^. _j_ ^^(^^^ 

ZO J-b g[Zo, Ou,u) 

(14) 

where 



Bd = {\Tin\ < d} and d = ai,{b — Vb),b > 1, 



9 2 ^ 



5„(a, b) = ^j'' ]ElB /7^^'/^"^ ^n(n)rf^, 



6n{u)=pn{u) - Qn{u). 

Note that pn[u) > Poo{u) = exp [ua^rj — We can easily show that 

Epoo(ii) = 1 and we hav e also Kpn(u) = 1 because p„(u) is a density. Hence, 
using theorem 3.6 from Billingsley f 19991 ). {pn{u),n > 1} is uniformly inte- 



grable. And since gn{u) is bounded on Bd, we obtain the uniform integrability 

of {lBa^a,n{^^S'^,uWniu),n > 1}. 

Write 6n{u) = exp {uayrjn — ^^-j^) (e'"" — 1) and notice that exp (ua^rjn — ^^-^ 
is bounded on and that e*"" — 1 > 0. As a consequence one has 

n— »oo 

lBdV'a,n('S', P . n 

It follows that ^"""^rf'^r^ eJu) and E ^^^^'^f '^r"^ ^n(^) ^ 0. 

Ou^u) n — ^oo 

Finally bounded convergence yields 6n{a,b) > in ([1 

Now we are interested in the term Jn(a, b) in IHM . 
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First rewrite ^„(m) = CnC with (n = e''"/^ and fjn = —. Then if 

^ ~ 7V(0, 1) denote £ = —,( = e^'/^ 5^ = {|^| < d} and E the expectation 
for the probabihty law of C,. With t„ = (p^Snizo), we get 



cr:, 



exp ( -yl^i - Vny] du 



C\ r ^^#^exp f-^(n-0^1 du. 



We have the following limit 

tl./4 exp - if) (-^ - ^ 0. 

(15) 

Indeed, using hypothesis ([6]) and (171) one obtains 



O". 



0". 



du 



du 



'26 7-6 



Co II s,y^u II +|r2o,o(>s';/,u) I 



Since || 5'^,^ || tends to zero as n goes to infinity, hypothesis ([8]) and f|T5l) allows 
then us to say that 



liminf Jnia.b) = liminf EIb C— 



1 /•'' - t„) 



0-,, 



. , , exp ( -(u — f)"^ ] du. 

2bJ-b gizo,0) 2 ^ ''M 



But 



^ 1 vj;u-t^ (at _ ~\ 



- ''^^2bJ-V-bgizo,0) 2 i ' 
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this l ast inequality holds thanks to Anderson's lemma (see llbragimov and Has'minskii 



198ll . Chapter II, Lemma 10.1 and Corollary 10.2). 

Eventually using the fact that EI^^^ = ^^—^ ^^ it follows that 

liminf liminf J„(a, 6) > J^ - — --^ / — -LI — - exp { -t}\ dt. 

' ^ b J-Vbg{zo,0) \ 2 J 

We complete the proof limiting successively b oo, u and utilizing 
2 2 

a > . □ 

5. 2 Proof of theorem \3.2\ 



We begin by rewriting the kernel estimator as Sn{zo) — S{zQ) = Bn+^^Cn with 



Bn = -j: - ^(^o)) (16) 

(In k=l 

Cn = ^ E Q(^^)^7(a^., S)^,. (17) 



First we take a look at the term . By (1171) . Cn is a Gaussian random variable 

N'(o,(7'^{S)^ where o"^(5') = — ^ — ~^9'^i^k, S). We prove in lemma 

I A. 3 1 that the variance cr^(5') satisfies cr^(5') ^ g'^i^o, S). If ^ ~ ■A/'(0, 1), one 

has 



sup 



:E|^| sup 



^ s&u,^,s g{zo, S) 
< I sup \an{S) - g{zo,S)\+ 



'Qn g* \sew,o,5 



According to hypothesis 



and since = > 2, we obtain 



nh 



iCni ^ Eiei 



limsup sup E5- ^ ^ 

n^oo S&Uzo,5 g[ZQ,b)Jq^ V2 
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Now denote Uk = — Au^ = —r and rewrite (fT6ll as 

h nh 



Jl n 



with 



5n = — E Qi^k) {S{zo + hUk) - S{zo))AUk 

<i n 

2 1 2 

= ^ / (S{zq + /im) - S{zQ))du + 



(19) 
(20) 



n „i 

Rn = ^Q{uk){S{zQ + huk) - S^Zoj^Auk- / (^(^ro + /im) - S'(Zo))'^M 

fc=l -^"l 

E / f ^(zo + ^Mfc) — S'(2;o + ^^i))'^'W 

(^S'(2;o + hu) — S{zo)jdu, 



k=k, 

r-1 



where k* = [n{zo + h)] et /c* = [n{zo — h)] + 1. 
We can bound Rn as follows: 



I-Rni < E / h{uk — u)6 ^du+ / "^wciu + / /i5 



1 \ 65""^ 



Hence 



limsup sup 'E.sfn 



With regard to the term — / (^S{zo + hu) — S{zo)^du in (l20l) one has 



0. 



(21) 



2 .1 



(^S{zq + hu) — S{zQ)^du 
Then using the definition of U^q^s we get 



lim sup sup ^sfn 



2 -j^ 

^ / f5(zo + M - 5(zo))c/m 



6 

< -. 

- 2 



(22) 
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Finally ([H]), ([2TD and limiting S ^ m yield 
limsuplimsup7^^o,^(S'„(^o)) < 

5^0 n^oo 1/ 2 



□ 



5. <? Proof of theorem 4-1 



This is a consequence of the theorem 13.11 which gives the sharp lower bound 
in the case of Gaussian errors having expectation zero and unknown variance 
which depends on the design point and the regression function. The corre- 
sponding risk 7lzo,s is less than the risk TZ^o^s because the density of the stan- 
dard Gaussian random variable belongs to Vs.l- The inequality in theorem 14. II 
is then proved. □ 



5.4 Proof of theorem \4.S\ 



Writing Snizo) — S{zq) = Bn + C,nl ^Jfh.-, with and Cn defined by (fT6|) and 
(1171) . we remark that B^ does not depend on the distributions of the random 
variables ^fc. That is the reason why fl21l) and (1221) remain available and provide 
for any b g]0; 1[: 

limsup sup ^r\Bn\ < 5/2. 
Hence it suffices to prove that 



lim sup sup 



-E|r/| 



(23) 



with r/ ~A/'(0, 1). 



Denote Cn = Cn/9{zo,S) = where Uk 

k=l 

and rewrite ^-^^^fe = ^'k + where 
9[zq, S) 



1 _g f Xk - zq \ g{xk,S) ^^ 



h 



9{zo, S) 



g{xk,S) 

^k = —^kii- 



g{xk, S) / 



I6I<9^ 



1/4 



gjxk, S) 



/4 
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Let u'u 



h 



zQ { ^^ I, ^° ) Cfc) then one gets 



h 



Cn = C + Cn — Xl'^fc "'^ X] "fc- Moreover, (tifc)fe>i is a martingale difference 



fe=i 



fc=i 



and for all A; > 2, we have \u'f^\ < 2^q^^/^ and 



Write 



1=1 



where G'„(5) = 5^Q 



Xi- Zo\ g^{xi, S) 



^ . h J g'^izo, S) 
Gn{S) 



and an^Var ■ 



Denoting rn{S) = — a„ and t„ = inf <^ /c : ^ E5 (uf\J^i_i^ > r„(5') L we 



i=l 



obtain r„ = inf < A; : ^ Q 



Xi — Zq 

h 



> Qn \ and C = £ 



fc=i 



Let us show that a„ and further r„(5') tend to 1 uniformly in p e P^.l and in 
S G ^20,5. Firstly we have: 



1/4 1/4 
/ 1/4 ^ P{x)dx - 1 + / xp{x)dx 

•I -In ■'-In 



The Cauchy-Schwarz inequality brings us: 



1/4 



,1/4 



xp{x)dx 



< 



Nevertheless by the definition of the set Ve,L-, we get 

r+oo 

Prom here it follows that 



/+00 
x'^I\x\>aP{x)dx > 0. 
„ -00 a^oo 



(24) 



sup sup |a„ — 1| < 2 sup Kp{ql/'^), 
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so the left term goes to zero as n goes to infinity. 
Using assumption (jl]) and the inequahty 



\rn{S)-l\ < 



Gn{S) 



H \ar 

Qn 



we get the convergence of r„(5') to 1 uniformly in p and in S. 



Applying lemma IA.4I shows on the one hand the convergence in distribution 
of ('^ to Af{0, 1) uniformly in p G Pe,L and in 5 G U^o^s because the function 
p in lemma IA.4I does not depend on the law of the martingale difference. In 
fact, if $ denotes the standard Gaussian distribution function, one has 



< 



\k=l 



Kk=l 



+ 



^x) - ^x/^fjS)) 



The second term of the right member of this inequality tends toward zero 
uniformly in p, in Sand in x because r„(S') 1 uniformly in p and in 5* and 
because $ is uniformly continuous on M. 



On the other hand one has IE|C"| uniformly in p and in S. Indeed one have 

G (S) 

immediately E(Cf ) = ^ Ky{(i^^). Then (El) and the Cauchy-Schwarz 

inequality yield 

sup sup EslCnl 0. 

Using Markov's inequality, we show that (C^') tends to in probability uni- 
formly in p and in S. 

As a consequence C^n — Cn Cn converges in distribution to ~ A/'(0, 1) 
uniformly in p and in S. This immediately implies fl23|l . □ 



A Appendix 



Lemma A.l Fix v g]0; |[ and 5 g]0; 1[. Then there exists an integer n^s > 
such that Si, G V{zo,s for all n > n^^s. 

Proof: First remark that j {Su{zo + uh) — S„{zo)) du = 0. Moreover one 
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has 



v 

' 1/ 



, fx - Zq 

h 



< 



-n 2/3+1 



For any fixed 5 in ]0; 1[, if we clioose n > 1 sucli tliat 



n 2/3+1 



< i.e. n > 



2/3+1 



.5\ ^- 



tlien Sy e ^20,5. 

Tfierefore we fiave tfie desired result. 



□ 



Lemma A. 2 We have the following limit: 



Proof: For sufficiently large n we have 



n ^ 

with yUn = ^ 51 ^k/n = and z/„ = 



(^) 

g^{x,Sy^u) 



Un{dx) 



k=l 



Using hypothesis ([6]) and ([7j) to the function g, we can write for all x G [0; 1] 



g'^{x,Su,u) 9'^{x,0) 



< 



+ 2g{x, 0)r^.,o(S';,,„) + 2L^.,o(5'i,,„)r^.,o(5',,,„)| 

< \ (2^*Co||5.,„|| + C2||5,,„f + |r,,o(5,,.) 
9* 

+ 2g*\T^,oiS,,u)\ + 2Co\\S,,u\\\r.,oiS,,u)\) ■ 



Hence 



< 



\g^{x,S,y^u) 9'^{x,0) 

\\Si,,u 



Un{dx) 
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f\n{dx) f2(7^Co + Col5,,J| + ( sup 



+ 2g^ ( sup H^^4nf^' 

\xe[0;l] IPi'.ull 



\^x,oiSt,^u)\ 
\\^i',u\\ 



2Co sup II „ 11 



II I 
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As (z/„) weakly tends to 25zq when n oo, one has 
hm / Unidx) = 2 et hm / f — - — 



0) 9^{zo,0), 



Vni^dx) = 0. 



Then taking into account hypothesis (IHD and because || Su,u \\ tends to 
n — i> oo, we obtain on the one hand 



/o \g'^{x,S,,^u) 9'^izo,0) 
On the other hand 

Y2 ( x-zo \ 

\ h ) 



Vnidx) 



0. 



g'^i.zQ.Q) 



-Pn^dx) 



1 n T/2 f ^k-zo \ 



nh^^ g'^{zQ,Q) J-i g^{zo,0) 



' KHy) 



■dy. 



Now, if V* denotes the maximum of V^^ on M, one has 



i9'{zo,0) 



< 



+ 



T/2 f x-zo \ 

\ h ) 



+ 



9^ 






( x-zo\ 
\ h ) 




/' 


1 


JO 


g'^{x,S 




( x~zo\ 
\ h ) 


^7^(^0,0) 



Un{dx) 



Un{dx) 



Y2 ( x-zo \ 

\ h ) 



6-^(^0,0) 



Vn{,dx) 



1^7^(^0,0) 

Vn{dx 



dz 



Un{dx) 



1 v,Hz) 



-dz 



-ig'izo,o) 

Let n goes to oo and then we have completed the proof of lemma IA.2I 

Lemma A. 3 The variance (j'^{S) of (n satisfies 

al{S)--^g\zo,S). 



Proof: One has 



k=l 



i-ZQ+h 

g\xk,S) =n g {x,S)^in{dx) 

J ZQ—h 



with the measure fin = - Ylk=i ^k/n- 

We know that (/in)n>i weakly tends to the uniform measure on [0; 1]. 
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Moreover for sufficiently large n, 



1 " 
k=i 



ZQ+h 



ZQ — h 



g^{x,S)un{dx) 



with 



MnI[zQ-Ji;ZQ + h] 



Like this (z/„)„>i weakly tends to 2Szo, Dirac measure at zq, when n — cx). 
Then we can conclude as we remember that — ^ > 2 and that nh = iol. D 

r n 



Lemma A. 4 (jFreedman . \l97A . pp. 90-91) Let 5 g]0; 1[ and r > 0. Assume 
that {uk)k>o is a martingale difference with respect to the filtration {J-'k)k>o 

oo 

such that \uk\ < 6 for all k and ^ K{u1\J-'k-i) > r. 

k=l 

Define r = inf < : ^ E(m^|JF^_i) > r > . 

I fc=i J 
Then there exists a function p : ]0;+oo[— > [0; 2] not depending on the distri- 
bution of the martingale difference, such that lim p{x) = and 

x—*0 



sup 



where $ is the standard Gaussian distribution function. 
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